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ABSTRACT 8 
This report evaluates the the teacher training and 


‘tutorial pregrag in reading in New York City. The program was 


“(Auther/uP) » 


aesigned to cffer after school instruction in 13 elementary schools 
and-4 junior high schcols. Three hundred ninety elementary school 
students afd 120 junior high students’ in grades two through nine 


_participated in the program. Tutorial classes met once or twice a 


week. for a total of two hours with the exception, of one junior high 
schocl where students met in the morning before the start of regular” 
classes. The program was administered by teachers, paraprofessionals, 
and high schcol students who provided indfvidual tutoring for two or 
three students. The major objective of the evaluation was to 
determine if, as a result of participation in the program, ‘there was 
significant isprovement in reading comprehension skills. All students s 
were given alternate forms of the Stanford Diagnostic Test on a pre 
and post-test basis. The report concluded that the tutorial program 
in reading was successful in the fourth, sixth, ahd seventh grades. 
There was growth in the second, third, fifth, eighth, and ninth 
grades but these grades did not show significant gains. 
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THE PROGRAM ; % 2 


“The teacher training and tutoral, program in read- 


. ing is designed to offer after School reading instructton 


v 


to Elementary School and Junior High School sttudents in 


2 


District 17, 18, 22 and 23. .The program is -presently in 


operation in 13 “elementary Schools and 4 Junior High Schools. 


The program ’started in September 1975 and ended in June 1976, 


In most of. the Behgols, the qjasses meet fora total of, 


.two hours of: instruction Once or twice per week, after the 


a 


school day has ended. ‘In one Junior High Sehool, the fro- 
gram meets two days per week, in the morning before the 
start of regular classes. In the clementary Schools, there. 
is a xeachsr sn charge, a paraprofessional plus up to 15 
student aides, who offer instruction. The student aides 
are high school etodsats, usually junior and seniors, who 
‘ea students-in four Community High Schools\ Each student 
aide provides individual, tutoring in reading for 2 or 3 
Elementary Schocl students. ‘There are approximately 160 | 
er aides in the program and they service eauncenate ls 
390° Elementary School students. 

In the four Junior High Schools, there is one teavher | 


in charge and one paraprofessional for each school. There 
are approximately 120 Junior itv School students served. 
Each child in.the’ program has been given parental 


permission to participate in the program. The parents are 


2 


E éontinually* apprised of their childrens" progress :and 


the parents are given facts about the program and are 
° ae 5 . ° 4 Se ® 
invited to meetings, concerning the program. 


‘ ; g | 
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EVALUATION PROCEDURES 
To determine if, as a resyglt.of participation ae . 
_ . in the program, there is a Statistically significant im- ~ -« 


provement in all reading skills, inclutiing -vocabulary,-com- 


prehension and phonics of the students in the program, , . ‘ 
? 


Subjects: 
All participants in the program. 


methods and Procedures: 


> 


All participants,in the program were given the 
appropriate level and the alternate forms of tne Stanford 


= ° ° 
Diagnostic Test, on a pre-test and a post-test basis. 


“Data Analysis: 


Data was analysed for statistical significance 
-at the 05 1evel, between the post-test scofes on comprehensior. 
. . and the. anticipated: post-test scores of the Stanford Diagnostic 
Test. . 


¢ 4 = ee 
Time Schedule:’° 


The pre-test was administered during the first week 


° 


- ° o ry ‘ ; ° 


% 
. of Navember 1975 and the post-test during the first week 


- e 


of April 1976. 
In addition, oe visited each of the f 


seventeen schools, interviewed the teacher in charge, the 


- 
. 


para professionals and in some cases, the school principal. 


The after school classes, were also observed in operation. 


CHAPTER III 
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EVALUATION O8JECTIVE § 


Evaluation Objective # 1, to determine if, as a re- 
ot 


I 


sult of participation in the program, there is a statistically’ 
‘significant ‘improvement in the comprehension Skills of the 


students in the program. 


FLNDINGS ; ; <= 
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Table.I presents the mean and standard deviation 


of the comprehension scores for grades 2-9 for the post- 


. 


test score, the pre-test score and the anticipated post- 


test score, 


Inspection of Table I, shows that in grades 3, 4, | 


5 6 and 9, the predicted post-test mean is larger than the 
observed post-tdést mean. The piedtoted post-test mean as- 
sumed that childrens growth in achievement is linear. In- 
spection of the raw data shows that this assumption does 


not hold for many of the children in this- program, For 7 


example, in. the third grade, a small: portion of the children. = 


° 
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. . 
x 


0 
hee ey 
: [ABLE T . 
Summary of Pre, Predicted Post and 
a oe Observed Post Program Reading Grade 
. 7 Equivalents. by Grade 5 . 
- ’ . ° a 
Fredicted Observed 
Pre Test Post Test Fost Test Pre Test/ oe 
: Obs. Pagst Predicted, 
grade ean S.D, ss» ean _S.0, i@an .S.D.. -_ -_ Obs. Post . 
2 2 l5o.o— 1.8 _— 2.1 —_ 4 
9 ge 2.'52 6,47 2.96 0.56 2.56 0.57 0.50 
bh 40: 2.79 0.46 3.12 0.56 3,07 0.79 2,95 9% 
5: 42 3.25 0.50 3.60 0.69 3.41 0.51 Le?7 
. 6 Fb 3.95 0.56 4.32 0.88 4.30 0:84 3.12 ** 
7. 2f °3.96 1.03 4.28. 1.10 4.75 112 ~ 3.64 #* © 2h, we 
8 2 35 — “4.70 i Baal ete ate 
9.17 ° 5,32 14h 5 5.6 1.59. 5.4% 14657 0.40 — 


*# Simificant at .01 level 


RE NIE Same 


“s 


fre 6 ete 


’ tested, had test scores on .the post-testing,° which were 


.* . 


lower than ..ie pre-test scores. * fhe effect of these 
childrens’ Lowered reading achievement was to lower the” 
mean observed post-test score. Since tne anticipated post- 
‘test score was based, on the desumptlieni of linear growth, 


_ this score showed .a uniform increase. In those cases,™ 
? 
where the observed post-test mean was smaller than the 


predicted post-test mean, a correlated t test was ‘performed 


' J ; 
between the observed post-test mean-and the pre-test mean, 


‘ 


In grade 7, thgre was Significant growth between 
the observed post-test mean and the” predicted post-test 


meane p £01, In grades .4 and 6, there was significant growth 


between the pre-test mean scores’ and the post-test mean scores. 
p <.0l.- In grades 2 and 8, the mean scores show growth. ° 


Hqwever, the sample size is too small for tests of statistigal 
: @ pe “o . ‘ 
_ Significance. 
There were a number of limitations in ‘the original 
study design, which also have to be taken irito account, in 


irterpreting the results. First, the vocabulary scores could 


not be used because the Stanford Diagnostic Test, does not 


C) 


; : i ; . 
have grade equivalent norms, for the vocabulary subtest. 


Secondly, some of the childgen who were eres a in 
November 1975, were no longer’ in the classes and available 
for testing in April 1976. In the second: grade, the level I 
of the Stanford Diagnostic Reading Test, was too difficult _ 


for most of the second graders. - Therefore, they could not 


. ‘ 


“ve,adequately evaluated with this instrument. These lames” 
= ations limited the sample Size within our’ population. huge. 

theless, the statistically significant results do indicate” 
F ‘that the program is educationally useful for a large number. 


Og children, ee st ; . ig | 


“EVALUATION OBJECTAVE 


st 


’ 


¥ Evaluation, Objective # 2, to determire the’ extent a 


” * 


‘to whieh the program as actually carried out, coincided with: i 
-the programs proposal.* i 

In the evaluation report, the evaluator, must make.a 
statement concerning any discrepancies betweer ‘the program's 
REeDeTas and: the actual implementation. of the program. » : 

" Obs servations” were also conducted at 13 Elementary ‘, : 
Schools and the 4 Junior. High.Schools, during the period from’ 
"February 1, 1976, through April 12, 1976. liany of the teachers — 
were quite effective and dedteated. A large number of the 
children also seemed to be highly motivated for learning, 

- The tutors ‘were also highly activated and dedigated. ey 
of the tutors, however, had very little knowledge of phonics. 
Such, knowledge would help them in their work. The materials 

used in the classes were varied, adequate and generally 
abundant. - The physical plant was adequate. In some. cases, , 
corimunication between the home and the school, seemed to be 


‘ a : ‘ ; 
lagging and.could be improved. , For example, post cards could 


" be sent home when’ children were absent, There was no discrépancy , 


’ 


. 


. gts on cakes . is a 


s r ad 


between the program proposal and the actual implementation, 
~*~ a o 


‘* of tne program. 


Recommendations from.1974-75 Evaluation 


The Evaluation for 1974+75, made ‘5 "recommendations: 
4: oo - oe Be ig 
1. The program should be recycled. Implemented. . "bog? 
2. Plans to carry. out all administrative procedures for 
tutors, ‘at one time; in one place, should be implemented. 6 


Implemented, , ' 


3. Because the interest of teachers, tutors, and“pupils, 

‘seem to wane,. omce’ Spring testing has been concluded, . so 
consideration was tq have been given to- -foldins. more ‘. ’ 
‘frequent sess Yons during part of the school- year, over. 


a certain period of time. Iinplemented. 
a ae " . 
4, Because the teachers are trained -and’ the tutors are 


not, it would’ seem to be more effective if the teachers 
moved from group to group,.and the tutors reviewed ne 3 . 
_what ‘the teachers did, “The eduéational assistant? 

could .provide more help during ae “settling down" 

period,. and return to thbir’ paper work, while the . . 
teachers, pupils and tutors are at work. tytaiertat 


Se Future evaluators might want to.study the effect” that ; ’ 
participation has on tutors, e.g. does their GPA op 
‘ self-esteem improve. Not implemented because this is 
,not part of ‘the “official NoY.Co Board of Education ~ 

‘ study nail iaa she wy Ae 


is . ; : 
CHAPTER IV , : 


9 i es ~ Pe - Ls ; a 
5 a oe ; A . 
SUMMARY _OF MAJOR FINDINGS, CONCLUSIONS AND RECOMMENDATIONS 2 


a 


% Observation of the program in all 13 elementary 


Schools and.4 Junior High Schools, showed that the program 


- ‘ 


was educationally meaningful to a large number of children. 


Alreview-of test scores, showed that large numbers ‘of children 


made significant gaing in their reading achievement. In the 
* “, @ ‘ 5 : ‘ oe 
seventh grade, there was a statistically significant increase 


p *.01, between the observed post-test conrephens¢on score 


. 


and the predicted post-test comrephension. In the fourth 
and sixth grade, ali ee inlale Score, showed a statistically 


significant gain p ¢.0l, over the pre- -tést score, 


¢ 
. 


Conclusions. 


ve 
4 


The 1975-1976 tutoral.program in reading, was found. 


ew. 


to be successful, in the 2th grade and the 4th and 6th grade. 
There was growth: ‘in the 2nd, 3rd, sth, 8th and 9th ee but . 


it was not statistic ally Significant. a ‘ : 


‘ 


Recommendations 


1. Recycle and expand the ——— program. ! 


2. Future testing should use a test such as the Metropolitan 
Achievement Test, which. has a wide Yange of diffioulty. 
and can more easily accommodate a range from the second 
to the hinth grade. uJ . 


A hand book for ‘the tutors should be developed to present’ 
the tutors with some instruction in phonics, as vets. as, | 
‘a general orientation Lo the program. 


~ ° \ 
Greater efforts should be made in ‘fostering home, school 
communication ‘in the children being served in the program, 
b caida ‘post cards Sent home when children are ‘absent 


from’ the ‘program. 1s 


<9 


o 


5. Those teachers who are new to the program, should be 


® allowed to visit those teachers, who are more experienced 


- 


‘and effective in the program. 


6. Those tutors 10 are new to the program should be allowed 
to visit those tutors, who are more experienced and 


effective in the program. 


